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ABSTRACT 



This report examines how high stakes assessments affect 
dropout and high school completion rates. The focus is on five suggestive 
lines of evidence about this relationship. This evidence is drawn in part 
from studies done at Boston College or by researchers for the National Board 
on Educational Testing and Public Policy. The conclusion drawn is that high 
stakes testing programs are linked to decreased rates of high school 
completion. The evidence is mainly correlational, but it is suggestive enough 
to warrant further research to clarify the role of high stakes testing in 
decisions to drop out of school . The first evidence is from the era of 
minimum competency testing (MCT) . There was no MCT in half of the 10 states 
with the lowest dropout rates, and the states with the highest dropout rates 
had MCT programs with standards set at least in part by the state . A second 
piece of evidence shows that in schools with proportionately more students of 
low socioeconomic status that used high stakes minimum competency tests, 
early dropout rates, between 8th and 10th grades, were 4 to 6 percentage 
points higher than in schools that were similar except for the high stakes 
test requirement. The third piece of evidence comes from high school 
graduation testing and dropouts in Florida. A more complex relationship is 
suggested by the fact that only for students with moderately good grades was 
a significant increase in dropping out associated with failure of the high 
school graduation test. A fourth line of evidence comes from the evolution of 
high stakes testing in Texas, where findings suggest that some high school 
sophomores dropped out of school because of the requirement of satisfactory 
performance on the Texas Assessment of Academic Skills. A final point is the 
relationship among high stakes testing, grade retention, and dropout rates. 
Research has generally suggested that grade retention makes students more 
likely to drop out. Interaction with graduation test requirements may result 
in increased numbers of dropouts. (Contains 14 endnotes.) (SLD) 
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from the original document. 
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All schools test their students - on spelling and fractions, the content of 
yesterday's lecture, what they've learned this semester. Educational tests 
range from pop quizzes to so-called high stakes tests: those used as a basis 
for entrance to kindergarten, for promotion to the next grade, for gradua- 
tion, to determine teachers' and schools' effectiveness, and more. 



It's a bull market for high stakes testing that far surpasses the rush of 
the early 1970s to test minimum competency. We now call them assessments 
rather than tests; but the issues surrounding their uses and effects are the 
same. Assessments "worth teaching to" will bring about better teaching 
and learning; students will be better motivated; dropout rates will drop 
and graduation rates increase - or so we are told. 1 
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But the evidence does not necessarily support these conjec- 
tures. Occasionally, it even suggests the opposite. In this re- 
port, the National Board examines how high stakes assessments 
affect dropout and high school completion rates - important 
indicators of the health of any educational system. In particu- 
lar, we look at five suggestive lines of evidence on this relation- 
ship, drawn in part from studies done at Boston College or by 
National Board researchers. 

Our conclusion is that high stakes testing programs are 
linked to decreased rates of high school completion. The evi- 
dence is mainly correlational. However, it is suggestive enough 
to warrant further research to clarify the role of high stakes 
testing in decisions to drop out of school. We have made sug- 
gestions for the forms this research might take. 
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States with High and Low Dropout Rates 

Our first intriguing piece of evidence comes from the mini- 
mum competency testing (MCT) era. A study of the ten states 
with the highest and the ten states with the lowest 1986 drop- 
out rates shows a strong link between attrition or dropout rates 
and the use of high stakes MCT programs. 2 



There was no MCT in half of the ten states with the lowest 
dropout rates. The other five had MCT programs that involved 
rather low stakes: four used the tests to decide about remedia- 
tion; only one used them for accountability. None used them 
for critical decisions about graduation or grade promotion. Fur- 
thermore, in three of the latter five states, local, not state, edu- 
cation agencies set the standards. 

The states with the highest dropout rates had MCT pro- 
grams with standards set at least in part by the state. Nine of 
the ten used the tests in decisions about high school gradua- 
tion; four used them in decisions about promotion. In sum, these 
ten states used minimum competency tests with higher stakes 
and less flexible standards than the states with the lowest drop- 
out rates. 
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These data do not necessarily mean that high stakes MCT 
programs increase dropout rates. The states with the highest 
dropout rates differed in obvious ways from those with the low- 
est. The latter were largely western and midwestem, with pro- 
portionately fewer minority and poor students. Perhaps high 
dropout rates are symptoms of the educational system's fail- 
ure that spurred legislation of MCT programs in the first place, 
or perhaps MCT does contribute in some way to the dropout 
problem. In any case, crude as these comparisons may be, they 
underline the need to explore further whether and how high 
stakes testing and dropping out are related. 



High Stakes Tests, Low Socio-economic 
Status, and Dropout Rates 

A second piece of evidence, again correlational, comes from 
a study of the relationship between MCT in eighth grade and 
early high school dropout patterns. 3 Data from the 1988 and 
1990 National Educational Longitudinal Surveys were exam- 
ined to determine whether students who had to pass one or 
more minimum competency tests in eighth grade were more 
likely to have dropped out of school by tenth grade than stu- 
dents who did not. Results show that in schools with propor- 
tionately more students of low socio-economic status that used 
high stakes minimum competency tests, early dropout rates - 
between the eighth and tenth grades - were 4 to 6 percentage 
points higher than in schools that were similar but for the high 
stakes test requirement. 

There may be many reasons for this apparent link. For ex- 
ample, the higher dropout rates may be symptoms of other 
problems in the school such as low student motivation or lack 
of support programs for students in danger of dropping out 
due to various life pressures. However, the data still suggest 
that more attention should be paid to identifying the possible 
differential impact of high stakes testing policies on students 
from different socio-economic groups. 



◄ Results show that in 
schools with propor- 
tionately more students of 
low socio-economic status 
that used high stakes 
minimum competency 
tests, early dropout rates - 
between the eighth and 
tenth grades - were 4 to 6 
percentage points higher 
than in schools that were 
similar but for the high 
stakes test requirement. 
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High School Graduation Testing and 
Dropouts in Florida 



Only for students with ► 

moderately good grades 
(in the range of 1 .5 to 2.5 
on a 4-point scale) was 
failure on the test 
associated with a 
significant increase in 
likelihood of dropping out 
of school. 





A third piece of evidence suggests a more complex rela- 
tionship between high stakes testing and dropout rates. 4 In this 
study, based on records for grades 10, 11, and 12 in Florida, 
researchers sought to control for other factors associated with 
dropping out of high school, such as gender, grade point aver- 
age, English language proficiency, and whether students were 
enrolled in dropout prevention programs. Results show that 
students who performed poorly on the Florida high school 
graduation test were more likely to leave school, but that this 
relationship was affected by students' grades. For students with 
lower grades, there was no apparent relationship between fail- 
ing the graduation test and the probability of dropping out. 
Only for students with moderately good grades (in the range 
of 1.5 to 2.5 on a 4-point scale) was failure on the test associated 
with a significant increase in likelihood of dropping out of 
school. Moreover, this study found that after controlling for 
grades, failing on the high stakes test did not increase the like- 
lihood of minority students' dropping out of high school any 
more than it did that of non-minority students. 



High School Graduation Testing and High 
School Completion in Texas 

A fourth line of evidence concerns the evolution of high 
stakes testing in Texas and patterns of high school completion 
in that state over the last twenty years. Texas has had a state- 
wide high school graduation test since the mid 1980s - first the 
Texas Educational Assessment of Minimum Skills (TEAMS), 
and then the Texas Assessment of Academic Skills (TAAS). The 
TAAS measures the Texas statewide curriculum in reading, 
writing and mathematics at various grades between 3 through 
8; at grade 10 students take the exit level tests. Since 1991, a 
high school diploma requires satisfactory performance on the 
TAAS exit tests. Research findings suggest that because of this 
requirement some 40,000 of Texas's 1993 sophomores dropped 
out of school. 5 The dropout rates for black, Hispanic, and white 
students were about 25 percent, 23 percent, and 13 percent re- 
spectively. In addition, it was found that the average black and 
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Hispanic student was three times more likely to drop out, even 
controlling for socio-economic status, academic track, language 
program participation, and school quality. 



While these data concern just one cohort of Texas high 
school students, they fit well with Texas enrollment patterns 
over a 20-year period that one of us (Walt Haney) has observed 
in connection with research for a lawsuit challenging the gradu- 
ation test in Texas (see Figure l). 6 Haney found that the ratio of 
high school graduates in a particular year to the number of 
ninth graders three years earlier declined only slightly between 
the late 1970s and 1991. For example, between 1978 and 1985- 
86, the ratio of high school graduates to grade 9 students three 
years earlier was in the range of 0.72 to 0.78 for white students 
and between 0.57 and 0.64 for black and Hispanic. Between 



Figure 1 



Ratio of Texas High School Graduates to Grade 9 Enrollment 3 
Years Earlier, 1 978-79 to 1 997-98, by Ethnic Group 
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...in 1990-91 (the year the 
new, more difficult TAAS 
high school graduation test 
was implemented), the 
ratios for all three groups 
evidence the most 
precipitous drops in the 
entire 20 years and were 
about 50% greater for 
black and Hispanic than for 
white students. 
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1985-86 (the year the TEAMS graduation test was first admin- 
istered) and 1989-90 these ratios fell very slightly for all ethnic 
groups. In other words, high school graduation testing in Texas 
in 1985 did not dramatically impede the progress of students 
from grade 9 to high school graduation. However, as Figure 1 
shows, in 1990-91 (the year the new, more difficult TAAS high 
school graduation test was implemented), the ratios for all three 
groups evidence the most precipitous drops in the entire 20 
years and were about 50% greater for black and Hispanic than 
for white students. From full implementation of the TAAS as 
a requirement for high school graduation in 1992-93 until 
1997-98, the ratio of high school graduates to grade 9 students 
three years earlier has been just at or below 0.50 for black and 
Hispanic students, while it has been just about 0.70 for white 
students. 



We discuss the Texas data in more detail below, but these 
patterns suggest that high school graduation testing in Texas 
affected the rates of high school completion differently in the 
1990s than in the 1980s and that this impact was more severe 
for minority students. The fact that the less difficult TEAMS 
test did not dramatically affect completion rates seems at odds 
with the first piece of evidence presented in this paper. That 
evidence suggested that even tests of minimum competency 
are associated with higher dropout rates when used for high 
stakes decision-making. However, that study did not focus spe- 
cifically on the effects of such tests when used as a graduation 
requirement. It would be interesting to explore the effect that 
the difficulty level of a graduation test has on high school 
completion rates, both overall and for different student groups. 
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High Stakes Tests, Grade Retention, and 
Dropout Rates 

A fifth line of evidence comes from research on the rela- 
tionship between grade retention, being overage for grade, and 
dropout rates. Research on the effects of grade retention has 
generally concluded that, at least beyond the early elementary 
grades, its harms outweigh its purported benefits. 7 In particu- 
lar, being overage for grade as a result of being held back eats 
away at students' sense of academic worth. The impact is espe- 
cially severe for black students. Overage students are twice as 
likely as on-grade students to be retained in grade again. 8 In 
addition, many of them ultimately become disengaged and drop 
out. 9 In fact, being overage for grade predicts dropping out bet- 
ter than do below-average test scores. 10 

These findings recall events fifty years ago in Ireland. A 
primary-school leaving certificate examination was given to all 
sixth graders between 1943 and 1967. To reduce the potential 
failure rate, teachers simply did not promote weaker pupils, 
mainly at two points in the system — grades 3 to 4 and grades 
5 to 6. A pupil that was held back at one or both points was old 
enough to leave school before reaching the sixth grade, reduc- 
ing the number of overage students that ever sat for the pri- 
mary examination. 11 

The Irish example is worth keeping in mind when looking 
at grade enrollment patterns in Texas. Figure 2 shows that the 
ratio of Texas ninth graders to eighth graders one year earlier 
has been increasing steadily since the early 1980s for black and 
Hispanic students, while remaining relatively constant for white 
students. By the late 1990s, there are close to 30% more black 
and Hispanic students in grade 9 than in grade 8 the year be- 
fore. While these progression ratios show a fairly consistent 
linear trend over the last two decades , they become more 
suggestive when combined with the information in Figure 3. 
Figure 3 shows grade progression ratios for grades 1 through 
12 for black, white, and Hispanic students between 1996 and 
1998. The dramatic upswing in the grade 9 to grade 8 ratio for 
black and Hispanic students and the dramatic downswing in 
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the grade 10 to grade 9 ratio for the same groups of students 
suggest that many of these students are being held back in 
grade 9 - the grade preceding the first administration of the 
TAAS graduation test. Given what we know about the effects 
of grade retention and of being overage for grade, it would be 
worth watching closely how such retention policies - informal 
or otherwise - affect rates of high school completion, and how 
they interact with graduation test requirements. 



Figure 2 



The Texas data also shed interesting light on the seemingly 
anomalous Florida study mentioned earlier. This was the study 
that suggested, contrary to most other literature, that failing 



Grade 8 to 9 Progression Ratio, 1 976-77 to 1 997-98 
by Ethnic Group 
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that state's high school graduation test did not increase the like- 
lihood of minority students' dropping out of high school. But 
recall that this study examined the records of only grade 10, 11, 
and 12 students. It turns out that Florida, like Texas, has un- 
usually high rates of retention in grade 9. 12 It also turns out that 
Florida, like Texas, has one of the lowest rates of high school 
completion - only about 80% - among the states. 13 However, 
the low rates of high school completion in these states are surely 
not due simply to their high stakes graduation tests; states in 
the South have historically had lower rates of high school 
completion than other regions of the country. 



Figure 3 



Grade Progression Ratio 1996-97 to 1997-98 
by Ethnic Group 
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Conclusion 


...the strands of evidence ► 
reviewed here indicate that 
high stakes graduation 
testing, together with 
grade retention practices 
that may be affected, both 
directly and indirectly, is 
associated with decreased 
rates of high school 
completion, especially for 
black and Hispanic 
students. 


The strands of evidence reviewed here indicate that high 
stakes graduation testing, together with grade retention prac- 
tices that may be affected, both directly and indirectly, is asso- 
ciated with decreased rates of high school completion. The evi- 
dence is divided on whether there is a differential effect by race. 

While many policy makers and the public have expressed 
general concern about whether high stakes testing will increase 
dropout rates, research needs to focus on actually document- 
ing patterns of high school completion and the manner in which 
high stakes testing, together with other polices and practices, 
affects high school graduation. Schools, districts, and states also 
need to begin devoting as much attention to patterns of grade 
progression and graduation as they currently devote to report- 
ing test scores. To give one example, we think that analysis of 
student enrollment by grade, race and year, of the sort under- 
taken in Texas, might usefully be done for other states. 

Other useful research would involve tracking attrition pat- 
terns for different student groups and interviewing students 
who drop out in order to identify where they are leaving the 
system and why. Knowing where students are most at risk of 
dropping out can then aid in the targeting of needed resources 
and programs. It would also be helpful to track attrition be- 
tween October and April of senior year to discover when, and 
also why, students leave at this stage of their education. The 
effect of high stakes tests on schools' policies toward dropouts 
should also be examined in order to identify strategies that en- 
courage weaker students to stay in school and to do well on 
the test. 

Finally, dropout rates for schools, districts and states need 
to be calculated consistently in order to facilitate comparisons 
and cross-state research efforts to establish whether high stakes 
testing causes dropout behavior. A recent National Center for 
Education Statistics report made a significant step in this direc- 
tion by proposing methods for adjusting state dropout data to 
make it more comparable, also enabling the calculation of com- 
parable high school completion rates. 14 We trust that further 
research will build on this good example and help all of us move 
from suggestive correlational studies towards more definitive 
conclusions. 
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